# TabBench-Bio > TabBench-Bio is a living benchmark for tabular learning in high-dimensional biomedical regimes. It compares classical models, neural networks, AutoML, and tabular foundation models across controlled feature and sample budgets. Use the pages below for context and the canonical SQLite database for exact, structured results. Rankings are operating-point dependent and descriptive rather than universal. The website opens in Strict (primary) mode by default, matching the paper's primary analysis and using nominal-cell results without substitution. Dashboard JSON includes analysis_views.strict (primary). Its analysis_view_files map links separate Adaptive and Failures-omitted JSON files, loaded on demand. Leaderboard JSON top-level rankings follow the Strict default. Adaptive sensitivity results may reuse a verified smaller training-sample cell after a memory failure and are not measurements at the requested larger sample size. All explicit analysis_views remain available. All failed fits, including tuned models, use the constant predictor at the same cell, dataset and fold. A failure without its required source result stays missing. The Failures-omitted view drops failed runs instead of imputing them, which removes a model from those targets, so its ranking is computed on differing target pools and reads as an optimistic bound. Dataset-specific score exports use Strict results. ## Results - Generated from the result bundle at 2026-11-10T20:57:03.676588+00:00. - 46 registered datasets: 33 classification, 13 regression. - Dataset modalities: DNA methylation: 4, GLM/PLM Embeddings: 4, Gene expression: 11, Genomic prediction: 4, Metagenomics: 10, Molecular properties: 11, Other: 2. - 33 configured model configurations; 35 currently represented in aggregate results. - 28 feature-by-sample operating points currently have aggregate metrics. - 6,440 configured dataset-cell-fold evaluation points per model. ## Current reference results The predeclared reference operating point is p=10,000, n=100. Bradley–Terry Elo combines the classification and regression target comparisons at this cell and anchors Random Forest at 1,000. Target-bootstrap intervals quantify ranking uncertainty. 1. Kumo Tabular (L): Elo 1,239 (95% CI 1,182–1,302; 44 targets) 2. Kumo Tabular (M): Elo 1,226 (95% CI 1,159–1,290; 44 targets) 3. FTFM-1: Elo 1,210 (95% CI 1,153–1,268; 32 targets) 4. Seldon: Elo 1,210 (95% CI 1,145–1,280; 44 targets) 5. Seldon-Mini: Elo 1,199 (95% CI 1,136–1,268; 44 targets) The leading intervals overlap, so the displayed order should not be interpreted as a statistically resolved universal ranking. Use the interactive controls or canonical database for other operating points. ## Evaluated models AutoGluon, CatBoost, Causilo, Constant, Extra Trees, Extra Trees (tuned), FTFM-1, GeneICL, KNN, Kumo Tabular (L), Kumo Tabular (M), LightGBM, LimiX2, Logistic Regression, Logistic Regression (tuned), MITRA, MLP, MLP (tuned), Random Forest, Random Forest (tuned), RealMLP, RealTabPFN 2.5, RealTabPFN v2, Seldon, Seldon-Mini, TabDPT, TabFM, TabICL v2, TabM, TabPFN 3, TabPFN 3.5, TabPFN Wide (8k), TabPFN Wide 5k (ne3), XGBoost, XGBoost (tuned). ## Training-data overlap - † TabDPT: Part of the benchmark training data was used in the training process of this model. These models remain in the benchmark results but are excluded from the Reference leaders podium and social card. ## Tuned models and chart interpretation Tuned models use a small predefined grid under a one-hour budget. Candidates are selected on a training-only holdout, then the winner is refitted on the full training fold. The frozen result configuration records the grid and selection protocol. Read `models[model_id].tuned_from` and `training_data_overlap` from the dashboard model metadata; these come from the JSON model registry. Untuned Random Forest remains the Elo reference at 1,000. Paired bars show untuned Elo plus the signed tuning change, with a diamond at tuned Elo. Paired rows are ordered by max(untuned Elo, tuned Elo); this display ordering leaves the original ratings unchanged. Only the tuned 95% interval is drawn for a pair; it is not an interval on the tuning change. Displayed error bars are clipped at zero; original statistical intervals remain available in exports and hover details. Budget-response line plots omit untuned parents when their tuned versions are shown, while exports retain both. Unpaired models remain visible. System configuration: NVIDIA L40S with 48 GB VRAM, 16 CPU cores and 80 GB RAM. ## Agent skill Here is a skill for your agent: [TabBench-Bio model selection](https://anonymous_iclr.codeberg.page/TabBench-Bio-Anonymous/skill.md). Use it to match task, modality, budgets and compute constraints, and interpret uncertainty and training-data overlap. Download the Markdown file directly; no repository clone is needed. ## Primary pages - [Benchmark and interactive results](https://anonymous_iclr.codeberg.page/TabBench-Bio-Anonymous/) - [Dataset registry](https://anonymous_iclr.codeberg.page/TabBench-Bio-Anonymous/datasets/) - [Model registry](https://anonymous_iclr.codeberg.page/TabBench-Bio-Anonymous/models/) - [Artifact browser](https://anonymous_iclr.codeberg.page/TabBench-Bio-Anonymous/artifacts.html) - Manuscript: REMOVED ## Machine-readable data - [Dashboard JSON](https://anonymous_iclr.codeberg.page/TabBench-Bio-Anonymous/data/dashboard.json): modality-specific rankings, costs, coverage, analysis views and model flags. Display measurements use six significant digits; model metadata (including tuning grids) is stored once in models, keyed by model_id. Elo ratings, counts and protocol parameters remain exact. - [Leaderboard JSON](https://anonymous_iclr.codeberg.page/TabBench-Bio-Anonymous/data/leaderboard.json): aggregate rankings. - [Dataset index JSON](https://anonymous_iclr.codeberg.page/TabBench-Bio-Anonymous/data/datasets/index.json): task-specific metrics and links to per-dataset scores. - Results SQLite download: REMOVED for anonymous review. ## Citation Identifying citation information is REMOVED for anonymous review. Anonymous citation files: [CITATION.cff](CITATION.cff) and [CITATION.bib](CITATION.bib). ## Optional - [Changelog](https://anonymous_iclr.codeberg.page/TabBench-Bio-Anonymous/changelog.html): notable benchmark and website updates - Source repository: REMOVED